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ABSTBACT 

Beported is the evaluation the Division of Special 
Education and Pupil Personnel services (d5BPPS) 1975-76 Supplementary 
Beading Program for Handicapped Children ubich operated in 43 schools 
in New York City and served 1,578 childj:en (5^16 years old) through 
two agencies—the Bureau for the Education of the physically 
Handicapped (BSPBJ and the Bareau for Children of setarded Mental 
Development (CBflD) . The reading Program i^ noted to haye employed a 
repeating sequence of diagnosis/ prescription, remediation, and 
evaluation. A&ong the evaluation objectives listed were statistically 
significant improvement of ss in their readii^S grade level and 
mastery of eight previously failed instru^^tional objectives in 
reading. Findings are reported terms ot evaluation objectives, 
field evaluation check list, discrepancy analysis, and 
recommendations from the prior year's eval^^tion. it is concluded 
that the DSEPPS Beading Program did proau^^e statistically significant 
improvement in children's reading level; that it was not demonstrated 
that 70S of any of the groups of children ^^^^ able to master eight 
or more instructional objective^ from the California Prescriptive 
Beading Inventory; that for the fl^ajority of children, participation 
in the program resulted in the mastery of iiistructional objectives 
which were failed on the pre^test; and that the program coincided 
with the project proposal. Tables with statistical data are provided; 
and appended materials are given which include a sample information 
report form, a data loss form, and a program abstract. (SBH) 
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CHAPTER I: THE PROGRAM 

Xrhi's report is an evaluation of Lhe Division of Special Education 
and Pupil Personnel Services (DSEPPS) Supplementary Reading Program for 
Handicapped Children, 1975-76. The evaluation is specifically concerned 
with two subsets of children in the program: (1.) children serviced by 
the Bureau for the Education of the Physically Handicapped (BEPH) and 
(2) children serviced by the Bureau for Children of Retarded Mental 
Development (CRMD) . 

The DSEPPS Reading Program was operated in a total of 43 schools 
located in the five boroughs of New York City, Eighteen of the sites 
serviced BEPH children; 25 of the sites serviced CRMD children. There 
were 18% teachers (one teacher worked a half-time schedule) and one para- 
professional connected with the BEPH sites and 20 teachers and one para- 
professional connected with the CRMD sites. Some of the teachers worked 
split schedules, teaching at two different sites during the week. There 
were 762 BEPH children in the program and 816 CRMD children. The chil- 
dren were from five to sixteen years old. Children were selected to 
participate in the program on the basis of standardized diagnostic reading 
test scores in the children's permanent files. The DSEPPS teachers and 
the children's regular teachers evaluated these scores and jointly de- 
cided which children would be benefited most by the program. 

As a result of participation in the program it was expected that the 
children's reading ability would improve as measured by the Stanford 
Reading A chievement Tes t and the California Prescriptive Reading Inven - 
tory , The pedagogical methodology employed by the teachers followed a 
repeating sequence of Diagnosis, Prescription, Remediation, Evaluation, 
The specific techniques of reading instruction varied from teacher to 

i 



2 



teacher, but in each case vjcre characterized by small group and one-on-oae 
instruction, a variety of materials suitable for children with limited 
attention spans, and small step reinforcement procedures designed to 
guarantee each child v;ith success experiences regardless of the child's 
actual level of performance. The DSEPPS Readiir Program operated from 
September 1, 1975 through June 30, 1976, 



CHAPTER II: EVALUATIVE PROCEDURES 

The evaluation objectives of the program, as stated in the Evaluation 
Design '-' were . 

#1: To determine if, as a result of participation in the program, 
handicapped pupils achieve a statistically significant improvement 
in their reading grade level, 

#2: To determine if 70 percent of the pupils master eight instruc- 
tional ob jecti^'-es in reading which they failed to master prior to 
participation in the program, 

^^^3: To determine, as a result of participation in the program, the 
extent to which pupils demonstrate mastery of instructional 
objectives, 

^/4: To determine the extent to which the program, as actually 
carried out, coincided with the program as described in the Project 
Proposal, 

The evaluation instriunent used for Evaluation Objective #1 was the 
Stanford Reading Achievement Test (Primary I level. New York: Harcourt, 
Brace Jovanovich, 1974), Form B of the Lesi. was used for the pretest and 
and Form A for the posttest. The test is norm-ref erenced with scores 
given in grade equivalents. The instrument used for Evaluation Objectives 



•-•Roth, Wm, Evaluation Design: The DSEPPS Supplementary Reading 
Program for the Handicapped , B/E # 09-69605, Office of Educational 
Evaluation, Augtist, 1975, pp, 2-4, 
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#2 and #3 was the California Prescriptive Reading Inventory (Red, Green 
and Blue levels. Monterey, Cctlifornia: McGraw-Hill, 1972), A small 
group of 13 children in the CRMD group who were complete non-readers were 
given the Metropolitan Reading Readiness Test (Level II, Form P. New York: 
Harcourt, Brace, Jovanovich, 1976). These scores were evaluated separately 
under Evaluation Objective #1. Information collected during the site 
visits was usee, to evaluate Evabiation Objective #4. 

No random sampling procedures were used in the collection of the data 
since an attempt was made to test every child in the program. The data 
was broken into two subsets based on the children's participation in either 
the BEPH or the CRMD component. Each of these groups was further divided 
into children whose Stanford Reading Achievement (SRAT) pretest scores 
were obtained in May, 1975 and children whose pretest scores were obtained 
in November, 1975. The SRAT posttest was administered in May, 1976 and 
the data were collected at the beginning of June, 1976, Tlie Prescriptive 
Reading Inventory (PRI) pretest was administered in November, 1976, and 
the posttest was administered in May, 1976 with the data collected in 
early June, 1976. PRI interim tests were given periodically to enable 
the DSEPPS teachers to be accurate in their diagnosis-prescription- 
remediation-evaluation cycle. The Metropolitan Readiness Test was ad- 
ministered in November, 1975 and again in May, 1976. 

A t_ test for correlated samples was used for the SRAT and Metropolitan 
Readiness test data to evaluate statistically the effect of participation 
in the program. A _t test was computed for pretest-posttest SRAT scores 
for the Noy. *75 - May '76 group and for the May '75 - May '76 group in 
the BEPH component and for the same two groups in the CRMD component. 
A fifth t^ test was computed for the Metropolitan Readiness Test data. 
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The PRI data were subjected to frequency counts of (1) number of 
children initially mastering a given objective, (2) number of children 
failing the objective, (3) number of children mastering an objective which 
they had previously failed, (4) number of children who failed an objective 
which they had previously failed, and (5) number of objectives ultimately 
mastered by each child. 

While no limitation was imposed on the evaluation procedure by late 
funding, the pretesting for children with no May '75 scores was moved up 
from October to November, 1975 because of a city-wide teachers' strike. 
The strike- disrupted scheduling to the extent that November was the 
earliest point at which the pretest could be administered. 

CHAPTER III: FINDINGS 

The findings in this chapter are separate into the following sec- 
tions: Evaluation Objectives, Field Evaluation Check List, Discrepancy 
Analysis, Recommendations from Prior Year's Evaluation. 

Evaluation Objectives 

Evaluation Objective #1: To. determine if, as a result of 
participation in the program, handicapped pupils achieve a 
statistically significant improvement in their readinr^ grade 
level.- 

The results of the jt tests computed from the SRAT data and the 
Metropolitan Readiness Test data are presented in Appendix A, Table 11 
of the State Education Department (SED) Mailed Information Report (MIR). 
^ From the _t tests it was determined that the two BEPH groups (SED code 
6086146) showed a statistically significant gain in mean reading grade 



'*-Roth, Wm. Ibid. 
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level on the SRAT .01), The t tests for the tx^o main CRMD groups 
(SED code 6086142) on the SRAT data were also statistically significant 
(p^.Ol). T-Jhile the small group of absolute non-readers in the CRMD group 
given the Metropolitan Readiness Test did show an increase in mecin reading 
scores from pretest to posttest, the mean difference was not statistically 
significant. 

The pedagogical methodology employed to achieve Evaluation Objective 
#1 consisted of (1) small group instruction where DSEPPS teachers met 
with groups of approximately four children for fov.r sessions per week, 
with each session lasting approximately 45 minutes; (2) extensive lestJon 
preparation by the teachers designed to address each child' s specific 
reading problems; (3) a variety of materials which allowed a teacher to 
provide multi-sensory learning e:;periences and to switch materials if a 
child's attention to one set of material became exhausted; (4) a reinforce- 
ment system that focussed on each child's successes; and (5) regular 
conferences between the DSEPPS teacher and the children's regular teacher 
which provided a coordinated effort in dealing with each child's reading 
deficits. 

Evaluation Objective #2: To determine if 70 percent of 
the pupils master eight instructional objectives in reading 
which they failed to master prior to participation in the 
program.'" 

The results of the distributions compiled from the PRT data are 
presented in Tables 1 and 2 . 

Tables 1 and 2 are organized so that data from the BEPH Group and 
data from the CRMD group are presented separately; within each group, 
data are also presented separately for each level of the PRI - Red, Green, 

*Roth, Wm. Ibid. 
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Table 1 

DISTRIBUTION OF THE NUMBER OF INSTRUCTIONAL OBJECTIVES 
* MASTERED AFTER INSTRUCTION 





No. of 
Instr.' 


Red 


BEPH Group 
Green 


Blue 


C 

Red ■ 


RMD Group 
Green 


Blue 


Objectives 
Mastered 


N 


7= 


N 


7= 


N 


7= 


N 


7= 


N 


7= 


N 


7o 


0 


1 r\r\ 
iUU 




io 


11 


5 


r 
D 


126 


1 "7 

17 


2 


7 


0 


0 


1 


25 


5 


9 


6 


1 


1 


27 


4 


1 


3 


0 


0 


2 


35 


8 


7 


5 


2 


2 


39 


5 


2 


7 


0 


0 


3 


24 


5 


7 


5 


7 


8 


61 


8 


1 


3 


0 


0 


4 


39 


8 


12 


7 


2 


2 


61 


8 


1 


3 


0 


0 


5 


53 


12 


15 


9 


7 


8 


85 


12 


2 


7 


0 


0 


6 


50 


11 


20 


12 


13 


16 


86 


12 


5 


17 


1 


20 


7 


32 


7 


15 


9 


9 


11 


95 


13 


4 


15 


1 


20 


8+ 


102 


22 


58 


36 


39 


46 


150 


21 


11 


38 


3 


60 


TOTALS 


460 


100 


161 


100 


85 


100 


730 


100 


29 


100 


5- 


100 



and Blue. 

The findings presented in Table 1 are relevant to Evaluation 
Objective #1. A given N in Table 1 represents the number of children in 
a particular group (BEPH or CRMD) who took a particular level of the PRI 
posttest (Red, Green, or Blue) and who mastered the number of objectives 
indicated in the first column of Table 1 which they failed to master on 
the pretest. A given percent in Table 1 represents an N described above 
divided by the total number of children in a particular group (BEPH or 
CRMD) who took a particular level of the PRI posttest, multiplied by ICQ. 
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Table 2 

DISTRIBUTION OF PU3?IL MASTERY BY INSTRUCTIONAL OBJECTIVE AS 
A RESULT OF INSTRUCTION 





t 




BEPH Group 










CRMD Group 






SED 
Code 


Red 




Green 


Blue 


Red 




Green 


Blue 


Ratio 


7o 


Ratio 


7 


Ratio 




Ratio 


7o 


Ratio 


7o 


Ratio 




2101 


193/384 


50 


1 m / 1 o Q 
iUi/ LZo 


/y 






276/547 


50 


19/ 


DO 






2102 


198/349 


57 


47/58 


81 






314/567 


55 


7/10 


70 






2104 


148/311 


48 










268/551 


49 










2105 


131/297 


44 










300/533 


56 










2106 






67/88 


76 










8/18 


44 






2107 










34/40 


85 










^■/ 4 


100 


2108 






20/28 


71 


27/32 


84 






1/5 


20 


3/3 


100 


2109 






49/57 


86 


22/25 


88 






8/14 


57 


3/3 


100 


2110 






45/59 


76 










12/16 


75 






2201 


55/107 


51 






12/13 


92 


169/312 


54 






1/1 


100 


2202 


66/172 


38 


J3/76 


70 






96/239 


40 


3/9 


34 






2203 






30/ 5d 


54 










5/b 


63 






2204 


107/165 


65 


18/25 


72 


27/41 


66 


158/396 


40 


8/9 


89 


0/1 


0 


2205 


98/166 


59 


39/51 


76 






215/408 


53 


11/15 


73 






2206 


91/212 


55 










77/292 


26 










2207 


46/85 


54 






41/56 


73 


34/111 


31 






2/2 


100 


2208 










8/16 


50 










1/1 


100 


2301 


14/28 


50 






.17/19 


89 


42/81 


52 






1/1 


100 


2302 






3/4 


75 










1/2 


50 






2303 


15/24 


63 


6/7 


86 


13/13 


100 


5/14 


36 


4/6 


67 


1/1 


100 


2304 


24/48 i 


50 


1/1 


100 


20/23 


87 


88/128 


69 


6/9 


67 


0/0 


0 
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Table 2 continued 









BEPH Group 










CRMD Group 






SED 
Code 


Red 




Green 


Blue 


Red 




Green 


Blue 


Ratio 


L 




fo 


Ktl LIO 


/o 


Ratio 




Ratio 


1 .V 

7,. 


Ratio 


% 


2305 


28/69 


41 


30/37 


81 


31/37 


84 


89/189 


47 


10/10 


100 


4/4 


100 


2401 


13/45 


29 


1/4 


25 


3/5 


60 


21/50 


42 


4/9 


44 


3/3 


100 


2403 


22/63 


35 


26/48 


54 


22/35 


63 


38/82 


46 


2/6 


34 


4/5 


80 


2404 


79/235 


34 


30/73 


41 


35/50 


70 


80/169 


47 


5/8 


. 63 


1/1 


100 


2406 


32/136 


24 


41/97 


42 


31/55 


56 


53/145 


37 


9/13 


69 


3/3 


100 


2408 


33/85 


39 


10/24 


42 


14/38 


37 


39/86 


45 


3/5 


\J\J 


J/ J 


J.UU 


2409 


103/321 


32 


46/91 


51 


41/61 


67 


130/229 


57 


7/15 


47 


2/5 


40 


2410 










1/3 


34 










0/0 


0 


2411 










0/3 


0 










0/0 


0 


2412 


36/74 


49 


28/48 


58 


18/37 


49 


68/195 


35 


10/17 


59 


1/1 


100 


2413 






0/0 


0 


6/6 


100 






0/0 


0 


0/0 


0 


2414 










3/7 


43 










0/0 


0 



As may be observed from Table 1, reading across the percentages 
associated with the mastery of eight (or more) instructional objectives, 
none of the groups had 70 percent of their number who passed eight objec- 
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tives. That is, the instructional goal implicit in Evaluation Objective 
#2 was not achieved* 

The pedagogical methodology used in attempting to achieve Evaluation 
Objective #2 involved the use of the PRI pretest and the interim tests as 
diagnostic instruments and, subsequently, teaching specifically for the 
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objectives which were not mastered. 

Evaluation Objective #3 : To determine, as a result of 
participation in the program, the extent to which pupils 
demonstrate mastery of the instructional objectives,* 

The data presented in Table 2 are relevant to Evaluation Objective 
#3, The instructional objectives listed in the first column of Table 2 
are presented according to the State Education Department format. A given 
ratio in Table 2 represents the number of children in a group defined by 
the column headings who mastered the associated SED objective on the post- 
test, divided by the number of children in that group who attempted mastery. 
Each ratio is expressed as a percentage in the column directly to the 
right of the given ratio. Inspection of Table 2 indicates that for the 
majority of instructional objectives, the percentage of mastery after 
instruction averaged about 60%, but varied from 0 percent to 100 percent. 
The pedagogical methodology used to promote mastery of the instructional 
objectives was the same as described for Evaluation Objective #2. 

Evaluation Objective #4: To determine the extent to which 
the program, as actually carried out, coincided with the program 
as described in the project proposal.* 

During the course of the school year, every school which served as 
a program site was visited by the evaluator, and follow-up visits were 
made to some schools. These site visits were distributed throughout the 
school year, with the greatest number occurring from November, '75 - 
January, *76 and from March, '76 - May, *76. 

Field Evaluation Check- list 

The following description is based on a compilation of interview 
responses and evaluator observations and is organized according to 



*Roth, Wm. Ibid. 
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selected items from the Field Evaluation Check-list provided by the Office 
of Educational Evaluation. 

Student aLt^ndence and motivation ^ I^ile attendence and motivation 
were considered a problem, the great majority of the DSEPPS teachers said 
that attendence increased as children became involved in the program, and, 
concurrently, motivation to succeed increased. Several teachers indicated 
that their children were emotionally upset by being tested, and that 
absences were frequently the result of the children's fear of being tested* 

Degree to which actual classroom activities conformed with activities 
delineated in the program proposal . The observed classroom activities 
did conform to activities described in the program proposal. The activities 
were varied, involved the presentation of multi-sensory inf omation, and 
were designed to connect to pre-determined reading objectives. 

Relationship between class size and perceived program effectiveness . 
The DSEPPS teachers were unanimous in their perceptions that the single 
most effective factor in the program was the small group size. The 
teachers indicated that small group instruction was a prerequisite to 
success because of the limited attention span and emotional volatility of 
the children. 

Evaluator's perceptions of instructional staff morale . The great 
majority of the DSEPPS teachers indicated they were pleased with the pro- 
gram and that their morale was high. They attributed this to good rela- 
tions with the regular teaching and administrative staff of the school, 
to their experience of success with their children, and to the effective 
administration of the program. Those teachers who were less positive 
tended to indicate that too much of their time and their students* time 
was taken up by testing procedures, 

13 
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Inservico staff training for professional staff and staff perceptions 
of onRoinR staff training by prog^ram coordinator and by persons other 
than the program coordinator . The program coordinator conducted regular 
staff training sessions and also arranged with the Special Education 
Instructional Materials Center (SEIMC) a series of four special training 
sessions conducted by SEIMC personnel in every borough of New York City. 
In addition, special training sessions were held in which a team of DSEPPS 
teachers was videotaped during exemplary teaching sessions. These tapes 
were then used as instructional devices during inservice training sessions. 
Finally, two committees of teachers were formed, one of which devised 
procedures for the use of video taping in the classroom while the other 
organized a field source book for teachers. 

Materials: arrival^ quality and quantity > The most frequent 
complaint of the DSSEPS teachers was that the materials they ordered were 
late in arriving. In spite of these difficulties, the evaluator was 
impressed with the variety and quality of the materials the teachers had 
assembled and incorporated into the program. A great variety of teacher- 
made materials were used, and the creativity the teachers exhibited was 
remarkable. One example of note was a "book" produced by a team of 
DSEPPS teachers, made up of writings, experiments and observations of 
children in the program, interspersed with xeroxed reproductions of 
photographs of the children. The humor and intelligence used in the 
creation of this book, and the fact that it put the children's ovm 
thoughts, comments, observations and photographs into print, made it an 
excellent teaching device as well as a product of their learning which the 
children could keep. Other materials involved teacher-made games, audio- 
visual materials such as tape recorder with accompanying films or film 

14 
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strips, books, paper construction materials > three dimensiona? letters to 
be used tactilely, workbooks, ^^inforcetnent materials such as token systems 
and progress charts, and writing and drawx^^S niaterials. 

The attractiveness, spaciousness suitabilit y of the physical 
plant . The majority of the teachers had been provided with adequate 
space. In a few cases, DSEPPS teachers had been relegated to spaces which 
were too small or too public, but theso teachers were able to move to 
larger or more suitable spaces they became available. In every case 
the teachers and their students had made the environment attractive and 
interesting through the display of the chxl^^^'^' s work and with pictures 
and teaching devices which had aesthetic aS well as educational appeal. 

Discrepancy Analysis 
The program, as implemented, was found to coincide with the program 
as described in the proposal. The single discrepancy which was observed 
related to the turnover of children in the program and would seem to be 
an unavoidable problem associated with such programs. It is assumed, in 
the proposal, that a given number of children will be serviced at a 
particular school. However, owing to the turnover rate, children identified 
at the beginning of the year m^y not finish the school year. If a 
child is transferred, a new chi^d may take his or her place in the program. 
Thus, while the total number o£ children b^^i'^g serviced at a particular 
school remains constant, the actual identities of some of the children 
may change, and the continuity of service children who were trans- 

ferred and the children who replaced them is <^isrupted. It is important 
to understand, however, that tjie turnover rate of children in the program 
is no larger than the turnover rate of children in the New York City 
public schools in general. This is why the problem seems unavoidable. 

15 
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The program is servicing the needs of BEPH and CRMD children from 
5 to 16 years of age who were identified through diagnostic tests by the 
cooperative judgment of tax- levy and DSEPPS teachers as needing the 
program. 

Recommendations from Prior Year's Report- 

1. The central office should ensure that the receiving 
school cooperate with the program teacher and teacher trainer 
in providing supplementary reading and math invStruction. 

The recommendation was implemented in this year's program through con- 
ferences held at the beginning of the year for the DSEPPS teachers, their 
supervisors, a'^i the superintendents and/or principals of the receiving. . 
school. Many problems were avoided because of the information exchanged 
at these conferences. 

2. The program shonld reduce the number of schools each 
trainer is responsibl.'.- ;or covering. 

Budget cuts in this year's program eliminated the positions of teacher 

trainers. The recommendation is not applicable to this year's program. 

3. It is recommended that the program develop clear 
selection criteria for hiring supplementary reading and math 
teachers. 

ITie recommendation was implemented in this year's program. Every teacher 
in the program was a licensed, special education teacher. Several were, 
in addition, guidance counselors. 

4. Although there was a very intense 2-week orientation 
period at the beginning of the school year for program teachers, 
there was no systematic program of inservice education during 
the remaining school year. 

This year's program had a variety of inservice training sessions through- 



''^Siperstein, G.N. Evaluation Report: Supplementary Reading and 
Mathematics Instructional Skills Program for Handicapped Children . B/E 
Function # 09-59605 (c) , Office of Educational Evaluation, 1975, pp. 38- 



out the school year, centering on materials, techniques, and even the use 
of video tape. Tlie recommendation was implemented. 

5, It is recommended that teacher trainers ipeet on a 
regular basis with their program teachers. 

The recommendation is not applicable to this year's program for the reason 

given in response to Recommendation #2 above. 

6, It is recommended that at the beginning of the year, 
preferably during th^ initial orientation session, the program 
provide teachers with a curriculum package which would include 
an assortment of reading and math materials and diagnostic 
instruments . 

The recommendation was not implemented for the following reasons: (1) 
the great majority of the teachers, because they were licensed in the 
area of special education, brought to the program their own materials. 
(2) The diagnostic instruments were provided some time after the program 
was underway. (3) The teachers ordered their own curriculum package, 
appropriate for the children they were dealing with at the beginning of 
the year, but the materials tended to be late in arrival. 

7. It is recommended that teachers be screened in the 
beginning of the year according to their preference and desire 
to work alone or with a peer. 

Because of this year's budget crisis, it was impossible to distribute 

pairs of teachers in most of the receiving schools. The recommendation 

is a reasonable one, but could not be implemented beciiuse of the fiscal 

limitations of this year's program. 

8. It is recommended that a smaller number of junior high 
students be assigned to each supplementary reading and math 

• teacher. 

Again, because of budget limitations, the number of students assigned to 
each teacher could not be varied. However, care was taken to assign 
teachers most capable of handling potentially violent situations to classes 
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of older children and, to this extent, the recommendation was taken into 

consideration, 

9. It is recommended that students at the junior high 
school level be selected for participation in the program during 
the early part of the seventh grade. 

The recommendation is not applicable to this year's program since the 
children selected to participate are classified as ungraded. 

In the discussion of the prior year's recoramenddtions, it has been 
assumed that the reader understands that this year's program was limited 
to the teaching of reading, so that any reference to mathematics instruc- 
tion in last year's recommendations is not applicable to this year's 
program. 

CHAPTER IV: SUMMARY OF 14AJ0R FINDINGS , CONCLUSIONS, 
AND RECOMMENDATIONS 

Information relevant to each section of this chapter summary of 
major findings, conclusions, and recommendations — is presented separately. 

Summary of 14ajor Findings 

The SRAT test data were analysed separately depending upon (1) bureau 
servicing the child - BEPH or CRMD, and (2) date the pretest was given - 
5/75 or 11/75 • A separate analysis was performed on 13 children given the 
MRRT. Each of the four t^ tests for correlated samples performed on the 
SRAT data indicated highly statistically significant increases in moan 
reading achievement (p^.Ol). The t^ test for correlated samples performed 
on the MRRT data was not statistically significant at the .05 level. 
These results are presented in Appendix A. 

The PRI data were separated into distributions depending upon (1) 
bureau servicing the child - BEPH or CRMD and (2) level of the PRI - Red, 
Green or Blue. These data are presented in Table 1. There were no 

18 



16 



distributions in which 70 percent of the group of children under considera- 
tion mastered eight or more instructional objectives, A separate analysis 
of the PRI data was performed to determine the extent to which children 
mastered instructional objectives which they had failed to master on the 
PRI pretest. These data, presented separately for the BEPH and CRMD groups, 
for the level of the test (Red, Green, or Blue), and for each different 
SED instructional objective, may be inspected in Table 2. 

Tlie major findings of the site visits were: (1) small group size 
was the single most effective element of the program; (2) inservice train- 
ing was extensive and effective; (3) "materials which were or^^^ were 
frequently late in arrival, but the creativity the DSEPPS teachers showed 
in assembling and creating materials was exemplary and the material used 
were of a remarkable variety and quality; (4) the physical environments 
the program operated in were, in general, suitable, spacious and attractive; 
and (5) the good relationship between DSEPPS teachers and the regular 
school staff was a morale builder to the DSEPPS teachers. 

Conclusions 

In light of the evaluation objectives, it may be concluded that (1) 
the DSEPPS Reading Program did produce statistically significant improve- 
ment in the reading level of the children involved as measured by the SRAT; 

(2) it was not demonstrated that 70 percent of any of the groups of chil- 
dren were able to master eight or more instructional objectives on the PRI; 

(3) for the majority of children participation in the program resulted 
in the mastery of instructional objectives which were failed on the pre- 
test; and (4) the program, as actually carried out, coincided with the ' 
program as described in the Project Proposal. 
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* Recommendations 

Based on the findings of this evaluation report, it is recommended 
that the DSEPPS Supplementary Reading Program for the Handicapped be con- 
tinued. It is obvious that brain injured, mentally retarded, and physically 
handicapped children have very special educational needs. Fundamental to 
their education is ability in reading. The statistical evidence presented 
in the present evaluation indicates that the DSEPPS Reading Program in- 
creases that ability. Furthermore, it was demonstrated that these children 
can master instructional objectives in reading as a result of prescribed 
instruction. Finally , because of their^limited attention * spans and 
tendencies to act out, brain injured, mentally retarded and physically 
handicapped children function best in an educational setting where one 
child or a small group of children works with a trained, interested, 
empathetic adult. The DSEPPS Program provides for such small group in- 
struction and also provides highly qualified personnel to teach the children 

As a result of the present evaluation, the following recommendations 
can be made to improve the DSEPPS Reading Program for next year's operation: 

(1) Before the program begins next year, care should be taken to 
assure the speedy delivery of materials ordered by the teachers. 

(2) Tests other than the SRAT and the PRI should be considered for 
use in evaluating the performance of the children. The SRAT and the PRI 
were developed for normal children. Teachers connected their children's 
absences with the extensive testing program. Perhaps shortened versions 
of the tests could be used. 

(3) The quality of the teachers in the program should be maintained 
by the stipulation that DSEPPS teachers be licensed teachers with training 
in special education. 
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■ DSEPPS Supplementary Reading •Program 

■ Table U Norn reference^! : .;hLcveirnt data not applicable to Table 9. for the Handicapped, 1S75-76 

, : Function 09-69605 



In ,the' table below, enter the requested assessnent infor-ation about the tests used to evaluate the effect- ■ 
.iveness of major project ccnpor.ent/activities in achieving cognitive objectives, Before completing this form, 
read all footnotes; Attach additional sheets if necessary. ' ., 
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*./ Identify test used and year of publication (MW-58; CAT-70, 
"etc.) 

It Total nu^iber of participants in the activity. 
J/ Identify the participants by specific grade level (e.g., 
" grade 3., grade 5). Where several grades are conibined, 
/.. enter the 4th and 5th digits of the component code. 

Total number of participants for whom both pre and post 
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8/ Obtained value of test statistic (e.g. F=i3.25 
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.13. Criterion Referenced TestXRlUesults. Function f 09-69505 ■ 

In Che table belov, enter the requested informatioi. about criterion referenced tost results • 
used to evaluate the effectiveness of programs in reading and mathematics; particularly for those 
of less than 60 hcurs duration. Use the Instructional Mastery codes appended to this form 

for those skills which the program attempted to improve. Please provide data for each test • 
used and each level testdd, Use additional sheets if necessary. 
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DSEPPS Supplementary Reading Prograni for the Han^ 
13, Criterion Referenced Test (CRTl Results, Function 09-69605 * : 

In. the table beiov, enter the requested infomation about criterion referenced test results 
used to evaluate the effectiveness of progranis in reading and nathenatics; particularly for chose 
of less than 60 hours duration. Use the Instructional ^!astery codes appended to this forn 

for those skills which the prograrn atteiripted to improve. Please provide data for each test , 
used and each level tested. Use additional sheets if necessary. 
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13. Criterion Referaced Test CRD Results. Function 1 09-69605 

. In Che table belov, enter the requested inforrnatioii about criterion referenced test results 
used to evaluate the effectiveness of programs in reading and nathetnatics; particularly for those 
of less than 60 hours duration. Use the Instructional I'last^ry codes appended to this form 

for those skills which tbs program attempted to improve. Please provide data for each test 
used and each level tested. Use additional sheets if necessary. 
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13. Criterion Referenced Test CRU Results. Function ?09-6S605 • 

In the table below, enter the requested infoaatior, about criterion referenced test results 
use to evaluate the effectiveness of , programs in reading and niathcinatics; particularlv for those 
0. less tnan 60 hours duration. Use the Instructional Mastery codes appcndci! to this form 
. for those skills which the program atte^^pted to improve. Please provide data for each test 

^ used and each level tested. Use additional sheets if necessary. 
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DSEPPS Supplementary' Reading Program for the Handicapped, 1975-76 
13. Criterion. Referenced Test CRT) Results. Function -F 09-69505 - , 

, :. . In the table belov, enter the requested infonnatiou about criterion referenced test results : ' 
used to evaluate the effectiveness of programs in reading and raathoinntics; particularly for those . 
: . of less than 60 hours duration. Use the Instructional M<.story codes appended to this forn 

for those skills which the program attempted to improve. Please provide data for each test 
used and each level tested. Use additional sheets if necessary. 
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tional 
I'lastery 

Code 


Publisher 


Level 


Pretest I Posttesc , 


No, ol" Pupils No. of 


^0, of 
Pupils 
' from 
Col. (2) 
Failing 


Passing 


Failing 


: Pupils 
j from 
jCol. (2) 
1 Fa-sslng 


(1) 


. (2) 


6 




c 


6 


1 






2 


3 


0 


3 


Prescriptive j 
Eefldiocflnventorv^^^^^ 


92 




15 


9 ■ 


It 






1 






2 


3 


0 




(McGraw-Hill) 




75 


If? 


24' 




M 


1 




r 

4 

r 
1 




k 


3 


0 




II 


n 


35. 








II 






j 

i 






2 


k 


0 


1 


»f 


It 


3? ^5 


13 


32 


1 

i> 1 

1 


i 1 
1 ' 

1 






k 


0 


; 


M 






03 


22 


. 










i 






2 


h 


0 


ii 


tt 


II 




,235 


79 


156 


ri 








! 




1 


2 


k 


0 




»l 






136 j 32 

] 




1 










1 


k 


0 


8 


1 


11 


— ^. 


35 


33 1 
1 


52 


ti 












1 




.0 


Q 


M 


♦t 


37' ' 


321 


103 j 


218 


ft 


( 










i 


2 


k 


,1 


2 


tl 




59 


7^ 


1 

. 36: , 


,33 ^ 










! 



























DSEPPS Supplementary Reading Program for the Handicapped, 1975-76 
13. Criterion RefevMced Test (CRD RpsuUs, Function 1 09-69605 

In the table below, enter the requested infoniiatio,! about criterion referenced test results 
used to evaluate the effectiveness of programs in reading and nathcniatics; particularly for those 
of less than 60 hours' duratio:;. Use the Instructional I'Ustcry codes appended to this form 

for those skills which the program atteir,ptcJ to improve. Please provide data for each test 
used and each level tested. Use additional sheets if necessary. 
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tional 
.'•lastcry 

Code 


Publisher 


Level 


Pretest ! Posciest 


No. of 
Passing 


Punils 

1 

Failing 


1 No. of 

Pupils 
from 
Col. (2) 
Passing 


.\o. or 
Pupils 
frcni 
Col. (2) 
Failin:; 




1 (1) 1 (2) 






0 


5|l 




r 
1 

1 


0 


1 


frescnptive j 
Mnolnventor?-^^" 


IB 


128 


101 




M 




1 

. 1 

1 






1 1 
1 |2 


1 


0 


2 j(McGraj/-Hill) 






5S hi 


1 1 


tt 








1 




ikii 


0 


6 


tl 


i< 


46 


no 


1 ^7 


21 


II 






1 

1 

1 


i 
i 


2 


1 


0 


B 




It 


Or 




20 


P 

U 


If 




i i 


1 r 


t 


n 


Q 




11 


59 i 5? . 




0 
u 


II 




1 1 

! i 




1 

!- 


1 


1 


0 






hz \ 59 


^5 


14 : 


tl 






] 
1 

1 




2 


0 


2 


11 


" 1 22 

1 




53, 


23 














1 

1 


2 


0 


3 


II 


tl 

! 


29 5^ 30 1 


2 .6 ' 


II 

.—J 














2 


0 




II 


H 


62 


25 


1: 

1 


7 














12; 


2 


0 




tt 


" i 


70:: 


51 


3? 


12 
















2 


• 


0 


2 


It 


it 


1 

;o 1 


k 


3 


1 



DSEPPS Supplementary Reading Program for the Handicapped, 1975-76 
13. Cri:erion Rtferenced Test CRll Results. Function tr 09-69605 

' In the table below, enter Che requested information about criterion referenced test results 
used to evaluate the effectiveness of programs in reading and nathoniatics; particularly for those 
of less than 60 hours duration. Use the Instructional flastery codes appended to this forni 

: for these skills which the program attetr.pted to improve. Please provide data for each test 
used and each level tested. Use additional sheets if necessary, 
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DSEPPS Supplenientary Reading Program for the Handicapped, 1975-76 
13. Criterion Referenced Test CRD Results. Function t 09-69605 

In the table below, enter the requested infonnation about criterion referenced tect results 
■ used to evaluate the effectiveness of programs in reading and nathematics; particularly for those 
of less than 60 hours duration. Use the Instructional Mastory codes appended to this ff>rn( 

for those skills which the program attempted to improve. Please provide data for each test 
used and each level tested. Use additional shoots if necessary*. 
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DSEPPS Supplementary* Readin: Program for the HandicapoCjd, ISZS-ye 
13.- Criterion Referenced Test CRT) Results. Function TT 09-69605 

In tk^ table bclov, enter the requested informatioii about criterion referenced test results 
used to. evaluate the effectiveness of programs in reading and nathematics; particularly for those 
of less t'ran 60 hours duration. Use the Instructional ^lastory codes appended to this form 

for those skills which the program attempted to improve. Please provide data for each test 
used and each level tested. Use additional sheets if necessary. 
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OFFICE OF EDIICATIONM EVALUATION - DATA LOSS FOKH 

"(attach to mmm:) Function //_q^^5 dsEPPS Supplementary Reading Program 

forthe Handicapped, 1975-76 
In this table onter nil Data Losa Infoanatlon. DctwC'en the MIR and this form, all participants In t-ach activity 
; niuflt be accounted for. The component and activity codes used In completion of the MIR should be used here so that 
the two tables match, See definitions below table for further Instructions. 



Component 
Code 
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: (l) Identify the participants by specific grade level (e.g., grade 3, grade 9). Wliere several orades are combined, 
enter the last two digits of the component code. 

(2) Identify the test used and year of ptibltcatlon (MAT-70, SDAT-74, Houghton Mifflin (ffHS) Level 1 etc.) 

(3) Number of participants In the activity. 

(4) Number of participants Included In the pre and posttest calculations. 

(5) Number and percent of participants not tested and/or not analyzed. 

(6) Specify all reasons why students were not tested and/or analysed. If any further documentation Is available, 
_ please attach to this form. If further space Is needed to specify and explain data loss, attach additional 

Q-'gea to thla form. . 
n EjRJC Bch reason specified, provide a separate number count. ^ 
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APPENDIX C: PROGRAM ABSTRACT 

The DSEPPS Supplementary Reading Program for the Handicapped, 1975- 
76, operated in 43 schools in the five boroughs of New York City from 
September 1, 1975 through June 30, 1976 with a staff of 38 full time 
teachers, one half-time teacher and two paraprofessionals. ' There were ap- 
proximately 762 children associated with the Bureau for Children of Retarded 
Mental Development (CRMD) and 816 children associated with the Bureau for 
the Education of the Physically Handicapped (BEPH) serviced by the program. 

Analyses of pretest-posttest scores on the Stanford Reading Achieve - 
ment Test (Forms B and A, Primary 1 level) indicated highly statistically 
significant increases in mean reading grade level. These increases appeared 
attributable to small group instruction, to the quality of prescriptive 
instruction provided by the DSEPPS teachers (all of whom were licensed and 
trained in the area of special education), and to the cooperation and 
rapport established between the children's regular teachers and the rapport 
established between the children's regular teachers and the DSEPPS teachers. 

Distributions generated from the California Prescriptive Reading 
Inventory pretest-posttest scores were separated by BEPH-CRMD classifica- 
tion and by test level. From these distributions it was determined that 
none of the groups reached a mastery level where 70 percent of the group- 
achieved mastery of eight or more State Education Department instructional 
objectives. However, all of the groups did have a majority who did master 
instructional objectives which they had failed to master at the outset of 
the program. It was recommended on the basis of the evaluation that the 
progr.'un be continued. 
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